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Abstract 

In this paper we consider a linear system represented by a coupling graph between subsys- 
tems and propose a distributed control scheme capable to guarantee asymptotic stability and 
satisfaction of constraints on system inputs and states. Most importantly, as in [T] our design 
procedure enables plug-and-play (PnP) operations, meaning that (i) the addition or removal 
of subsystems triggers the design of local controllers associated to successors to the subsystem 
only and (ii) the synthesis of a local controller for a subsystem requires information only from 
predecessors of the subsystem and it can be performed using only local computational re- 
sources. Our method hinges on local tube MPC controllers based on robust control invariant 
sets and it advances the PnP design procedure proposed in in several directions. Quite 
notably, using recent results in the computation of robust control invariant sets, we show how 
critical steps in the design of a local controller can be solved through linear programming. 
Finally, an application of the proposed control design procedure to frequency control in power 
networks is presented. 
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1 Introduction 



Centralized advanced control systems arc nowadays ubiquitous for guaranteeing optimality, sta- 
bility, robustness and reliability in a wide range of applications, spanning from process industry to 
chemical plants and automotive/transportation systems. Their implementation requires measure- 
ments to be conveyed instantaneously and simultaneously to a central station, where the control 
law is computed. Then, the control variables must be transmitted from the central station to each 
actuator. As a consequence, when actuators and sensors are sparse over a wide geographical area, 
communication and computational requirements can be very demanding. Moreover, centralized 
design often hinges on the detailed knowledge of the whole plant and the availability of a dynami- 
cal model that must be amenable to designing control laws through advanced tools including, e.g. 
optimization steps on solution to matrix inequalities. 

The ever-increasing complexity and size of process plants, manufacturing systems, transporta- 
tion systems, and power distribution networks call for the development of distributed control 
architectures. Novel control approaches should enable decisions to be taken by a number of dis- 
tributed regulators with low computational burden and collocated with sensors and actuators. 
Furthermore, synthesis problems should be decomposed into independent (or almost independent) 
sub-problems. 

Decentralized and distributed control methods and architectures have been studied in the last 
decades to provide a solution to these issues. They are based on specific system representations 
requiring to split of the overall system into interacting subsystems. Interestingly, the interactions 
between subsystems can be described using directed graph representations which can be extremely 
useful to unveil the so-called system's structural properties [U [3] . Consistently with this graph- 
theoretical characterization, in this work the concepts of predecessor and successor will be used. 
Namely, a subsystem j is said to be a predecessor (respectively, a successor) of subsystem i if 
its state variables directly influence the dynamics of i (respectively, if its dynamics is directly 
influenced by the input /state variables oi i). 

In the last years many decentralized and distributed control schemes based on Model Predictive 
Control (MPC) 2] have been proposed, in view of the possibility of coping with constraints on sys- 
tem's variables [5] and the fact that predictions of the input and state trajectories can be exchanged 
among distributed regulators to guarantee stability, robustness, and global optimality. Available 
distributed MPC schemes span from cooperative [SI [Z] (guaranteeing system-wide optimality), 
to non-cooperative nes, which require limited computational load, memory, and trasmission of 
information [HI El [IHl E] ■ 

One the main problems of the above MPC-based controllers is the need of a centralized off- 
line design phase. While simplified and even decentralized stability analysis tools for distributed 
systems are available, based on aggregated models (see, e.g., the vector Lyapunov function method 
[3]), the design phase can in general be carried out in a decentralized fashion only in special cases 
[12) . To overcome this problem, in [1] a novel solution based on the PnP design paradigm 113] has 
been proposed. PnP design besides synthesis decentralization, imposes the following constraints: 
when a subsystem is added to an existing plant (i) local controllers have to be designed only 
for the subsystem and its successors; (ii) the design of a local controller uses only information 
from the subsystem and its predecessors. Quite remarkably, these requirements allow controllers 
to be computed using computational resources collocated with subsystems. Furthermore, the 
complexity of controller design and implementation, for a given subsystem, scales with the number 
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of its predecessors only. 

As in [1] we propose a PnP design procedure hinging on the notion of tube MPC [14] for 
handling coupling among subsystems, and aim at stabilizing the origin of the whole closed-loop 
system while guaranteeing satisfaction of constraints on local inputs and states. However, we 
advance the design procedure in [T] in several directions. First, in [I] the most critical step in 
the design of local MPC controllers required the solution to nonlinear optimization problems. In 
this paper, using local tube MPC regulators based on Robust Control Invariant (RCI) sets, we 
guarantee overall stability and constraints satisfaction solving Linear Programming (LP) problems 
only. Second, in [T] stability requirements where fulfilled imposing an aggregate sufficient small- 
gain condition for networks. In the present paper, we resort instead to set-based conditions that are 
usually less conservative. Third, while methods in [l] were tailored to decentralized control only, 
the new PnP-DeMPC can also admit a distributed implementation tacking advantage of pieces 
of information received online by predecessors. As for any decentralized synthesis procedure our 
method involves some degree of conservativeness [12] and its potential application to real-world 
systems will be discussed through examples. In particular, as in [1] we present an application of 
PnP-DcMPC to frequency control in power networks. Furthermore we highlight computational 
advantages brought about by our method by considering the control of a large array of masses 
connected by springs and dampers. 

The paper is structured as follows. The design of decentralized controllers is introduced in 
Section [2] with a focus on the assumptions needed for guaranteeing asymptotic stability of the 
origin and constraint satisfaction. In Section [3] we discuss how to design local controllers in a 
distributed fashion by solving LP problems and in Section 2] we describe PnP operations. In 
Section [5] we show how to enhance the control scheme taking advantage of pieces of information 
received from predecessors. In Section [6] we present applicative examples and Section [7] is devoted 
to concluding remarks. 

Notation. We use a : b for the set of integers {a, a + l,...,b}. The column vector with 
s components vi,...,Vs is v = {vi, . . . ,Vs). The function diag(Gi, . . . , Gs) denotes the block- 
diagonal matrix composed by s block Gi, i G 1 : s. The symbols © and G denote the Minkowski 
sum and difference, respectively, i.e. A ~ B (B C ii A = {a : a ^ b + c, for all 6 e i? and c G G} 
and A = B e G if a © G C B, Va e A. Moreover, 0'^^ G; = Gi © . . . © G^. Bp{z) C M" denotes 
the open ball of radius p centered in z G K". The controllability index of a given matrix pair 
{A, B) G R"^" X R"^" is denoted by CT{A, B). Given a set X C M", convh(X) denotes its convex 
hull. The symbol 1 denotes a column vector of suitable dimension with all elements equal to 1. 

Definition 1 (Robust Control Invariant (RCI) set). Consider the discrete-time Linear Time- 
Invariant (LTI) system x{t + 1) = Ax{t) + Bu{t) + w{t), with x{t) G M", u{t) G , w{t) G W" 
and subject to constraints u{t) G U C and w{t) G W C M" . The set X C M" is an RCI set with 
respect to w{t) G W, ifixit) G X then there exist u{t) G U such that x{t + 1) G X, \/w{t) G W. 

2 Decentralized tube-based MPC of linear systems 

We consider a discrete-time LTI system 

x+ = Ax + Bu (1) 

where x G M" and u G M™ are the state and the input, respectively, at time t and x+ stands for 
X at time t + 1. We will use the notation x(i), u(i) only when necessary. The state is composed 
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by M state vectors X[i^ £ M"' , z G = 1 : -A/ such that x = , . . . , and n = X^ieA^ 

Similarly, the input is composed by into M vectors G M™' , i E M such that u = . . . , it^^i/]) 

and m = Ejgm"^*- 

We assume the dynamics of the i — th subsystem is given by 

■ ^"^W = + BiU[,] + W[i] (2) 

where Aij E jj'iiX'b . i^ j g Al, G and A/i is the set of predecessors to subsystem i 

defined as Af^ = {j e M : Aij ^0,i ^ j}. 

According to the matrix A in ([T|) is decomposed into blocks Aij, i,j G Al. We also define 
Ad = diag(Aii, . . . , Amm) and Ac = A — Ad, i.e. Ad collects the state transition matrices of 
every subsystem and Ac collects coupling terms between subsystems. From ^ one also obtains 
B = diag(i?i, . . . ,Bm) because submodels ^ are input decoupled. 



Assumption 1. The matrix pair {Aa^Bi) is controllable, V« G A4. 

m 

In this Section we propose a decentralized controller for ([1} guaranteeing asymptotic stability 
of the origin of the closed-loop system and constraints satisfaction. 

In the spirit of optimized tube-based control |14j . we treat as a disturbance and define the 
nominal system as 

: x'^iii = Ai.iX[i] + BiV[i] (4) 

where ti[i] is the input. Note that ([4]) has been obtained from ^ by neglecting the disturbance 
term w^jj. 

We equip subsystems i G M with the constraints G X^, G Ui, define the sets 
X = riieA^ U = riieA^ ^^"^ consider the collective constrained system ((!]) with 

X G X, u G U. (5) 

The next Assumption characterizes the shape of constraints X^ and Ui, i G A^. 

Assumption 2. Constraints X^ and U; are compact and convex polytopes containing the origin 
in their nonempty interior. 

m 

As in [T3] our goal is to relate inputs in ^ to in ^ and compute sets Z; C M", i E Ad 
such that 

a;[,] (0) G (0) © Z; ^ xyi\ (t) G (t) © Z^, Vt > 0. 

In other words, we want to confine X[i]{t) in a tube around of section Z^. 

To achieve our aim, we define the set Z^, Vi G as an RCI set for the constrained system 
with respect to the disturbance Wi G Wi = ^j^j^/ ^ij^j- From the definition of RCI set, we 
have that if xjj] G Z^, then there exist u^i^ = Ki{x[i]) : ^ Vi such that a;+[i] G Z^, Vw[.i] G W^. 
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Note that, by construction, one has C X,; and therefore the RCI set could not exist if is 
"too big", i.e. Wi 3 X.;. Moreover if X[i] £ X[i^ © Z.; and one uses the controller 



(6) 



then for all G R™', one has x+j^] G © ^i- 

The next goal is to compute tightened constraints X^ C X^ and input constraints Vi C 
guaranteeing that 



G Xj, G V,,, yie M 

^ x(t + 1) G X, u(t) G U. 
To this purpose, we introduce the following assumption. 



(7) 



Assumption 3. There exist pi i > 0, pi^2 > such that Zi(BBp. ^(0) C X.; andU^. ©Sp. 3(0) C Ui 
where Bp^ ^{0) C K"' andBp^ ^{0) C R™- and U^, = Kj(Z,). 



If Assumption [3] is verified, there are constraint sets X^ and Vi, i G A^, that verify 

X, © Z, C X, (8) 
V,©U,. CU,. (9) 



Under Assumptions [T]|31 we set in ^ 

V[i]{t) = Ki{x[^{t)) = U[i](0|t), Xli]{t) = 1Ji{x[^{t)) = X[i](0|t) 



(10) 



where V[i] {0\t) and X[i] {0\t) are optimal values of variables V[i] (0) and X[i] (0), respectively, appearing 
in the following MPC-z problem, to be solved at time t 



{x[ii (t)) = min V li{x[ii (fc), (fc)) + Vf^ {x[i^ [N,)) 
i.[i](0:Wi-i) '^-^ 

;](0-X[,](0)GZ, 

;](fc + 1) = AiiX[i]{k) + BiV^^{k) 



keO:N,-l 
keO: Ni-1 
k£0: Ni~l 



(11a) 

(lib) 
(11c) 
(lid) 
(lie) 
(llf) 



In (fTTjl . G N is the prediction horizon and £i{x[i]{k),V[i]{k)) : R"i><™i R_|_ is the stage cost. 
Moreover V/. (xjjj (A'i)) : R"' — > R-|_ is the final cost and Kf. is the terminal set fulfilling the 
following assumption. 

Assumption 4. For all i G A4, there exist an auxiliary control law Kf"^{x[i]) and a IC^o Junction 
Bi such that: 

(i) £,(£[,],«[,])> K,(||(x[,],w[,])||), /or allx^^ G R"% v^^ G R"' and ^,(0, 0) = 0; 
(ii) ILf- C Xi is an invariant set for x'^[i] = ^^^[i] + i3iK°'"(x[i]); 
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■ 

Wc highlight that there are several methods, discussed e.g. in [TS], for computing £i{-), Vf.{-) 
and X/. verifying Assumption 21 In summary, the controller Cj^j is given by (jS]), (jlOp and and 
it is completely decentralized since it depends upon quantities of system E[i] only. 

The main problem that still has to be solved is the following one. 

Problem V: Compute RCIs li, i <^ M.i for ([2]). if they exist, verifying Assumption [3l 

■ 

In the next section, wc show how to solve it in a distributed fashion with efficient computations 
under Assumption [1] and [H In this case, we will also show how sets and V; verifying ([5]) and 
^ can be readily computed. 

Remark 1. In this section, as in |7]/, we introduced a DeMPC scheme based on tube-based control. 
In IJjj, using the robust control scheme proposed in USf . we set Ki(-) as a linear function, i.e. 

— = Ki{x[i-^ — This choice has the disadvantage of requiring the computation 

of matrices Ki, i £ Ai, fulfilling a global stability assumption. Differently, in the next section, 
using the control scheme proposed in \14^ , we will guarantee the overall stability for the closed-loop 
system through a suitable local computation of sets Z^. 



3 Decentralized synthesis of DeMPC 

From Assumption [5] constraints and U; arc polytopes given by 

X, = {x[,] G M"' : cl^_^X[,] < d,,,,, Vr G 1 : g^} (12) 

U, = G K"- : cl^ ^U[i] < du,^, Vr G 1 : k}, (13) 

where Cx^ ^ € K"' , d^^ ^ G M, Cu . G M™' and rft, . G M. Using the procedure proposed in [T7] we 
can compute an RCI set C using an appropriate parametrization. As in Section VI of |17] . 
we define Vi E A4 the set of variables 9i as 



0, = gE"' VsGl:fc„ V/Gl:g.; (14a) 

U[,]^''f'> eM."'^ Vs G : /ci - 1, V/ G 1 : g.; (14b) 

pF"-^'' e K V/i G 1 : q^, V/2 G 1 : g.; (14c) 

iP^'''''> G M Vr G 1 : Vs G : fe; - 1; (14d) 

7^'''''' G K Vr G 1 : 5i, Vs G : fe; - 1; (14e) 

a, G M} (14f) 



where ki, qi G N are parameters of the procedure that can be chosen by the user as well as the set 
Z° = convh({z[,](°'^) G R"', V/ G 1 : q,}), with = 0. (15) 
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Let us define the sets 

If, = convh({z[,]('^-'^' e M"% V/ G 1 : Vs 6 1 : fc^, with zyj^^'^^^ = 0, (16) 

and 

U^^ = convh({u[,;]('''^) e M™% V/ e 1 : g,}), Vs G : fc, - 1, with Uf.j^'^^i) = 0. (17) 
and consider the foUowing set of affine constraints on the decision variable 9i 

e, = {6, : a, < 1; - a, < 0; (18a) 

_ 1^ p|-^-/^)z[,](o./^) V/i e 1 : g,; (18b) 

/2 = 1 

-a,+ ^ pI-^^^-^^) <0 V/iel:g,; (18c) 

/2 = 1 

- p!-^''-^'^ < V/i e 1 : q„ V/2 e 1 : (18d) 

5] + du,.a, < Vr e 1 : (18c) 

s=0 

- ^'1'''^ < Vr e 1 : ;„Vs e : fc, - 1, V/ G 1 : q, (18f) 

X! 7^ '"^ + < rf.... Vr G 1 : (18g) 

c^.,.^W^"^^ - IP^^ < Vr G 1 : g„Vs e : fc, - 1, V/ G 1 : (18h) 

_ - =0 Vs G : fc, - 1, V/ G 1 : }. (18i) 

The following assumption is needed to compute the RCI set Z^. 

Assumption 5. The set is such that there is Wi > verifying Wi © B^.{0) C 



We highlight that, in view of Assumption [21 the set W; contains the origin in its nonempty 
relative interior. Hence, under Assumption [51 the set also contains the origin in its nonempty 
interior. 

The relation between elements of Qi and the RCI sets in Problem V is established in the next 
proposition. 

Proposition 1. Let Assumptions]^ and\^hold and sets X; and Vi be defined as in (|12p and (jl3p 
respectively. Let ki > CX{Aii,Bi). If there exist an admissible 9i G 6i, then 

ki-l 

Z, = (l-Q-,)-i0Z,f cX, (19) 

,s=0 

is an RCI set and the corresponding set is given by 

ki-l 

U,, -(1-a,)-' 0©!^ CU,. (20) 

s=0 
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Proof. In Section 3 of [T7j , the authors prove that set defined as in (fTO)) is an RCI set and that 
the inclusions in ([8]) and ^ hold. □ 



Remark 2. Under Assumption\^ the feasibility problem (jISp is an LP problem, since the con- 
straints in Qi are affine. In \17l the authors propose to find Q e 0; while minimizing different 
cost functions under constraints Qi in order to achieve different aims. In our context the most 
important goal is the minimization of ai that corresponds to the minimization of the size of the 
set Iji. We also note that the inclusion of in the definition of sets TL\, Vs G : hi, ensures that 
Z| contains the origin and hence, under Assumption\^ Iji contains the origin in its nonempty 
interior. 

We highlight that the set of constraints 8^ depends only upon local fixed parameters {An, Bi,Xi,Vi}, 
fixed parameters {Aij, Xjjjgjv. of predecessors of (because from Assumption[5]the set must 
be defined in such a way that Z° 3 Wi = ®j^_\f. ^ij^j) and local tunable parameters 9i (the 
decision variables (HI])). Moreover 8^ does not depend on tunable parameters of predecessors. 
This implies that the computation of sets Z^ and Uz- in and (|20[) docs not influence the 
choice of Zj and Uz^ , j ^ i and therefore Problem V is decomposed in the following independent 
LP problems for i E J\A. 

Problem Vi'. Solve the feasibility LP problem Oi G 8^. 

■ 

If Problem Vi is solved, then Vi G we can compute sets X.^ and in (jlldp and (jllep as 

i, = X,QZ,, V, GUz.. (21) 

The overall procedure for the decentralized synthesis of local controllers C[j], i G is summarized 
in Algorithm [TJ 

Proposition 2. Under Assumption\^and\^if, for alii G AA, controllers C[i] are designed according 
to Algorithm]^ then also Assumptions\^^and\^ are verified. 

If in Step [5] of Algorithm [1] the LP problem is infeasible, we can restart the Algorithm with a 
different ki. However the existence of a parameter ki such that the LP problem is feasible is not 
guaranteed [T7]. Steps O [3] and Oof Algorithm [TJ that provide constraints appearing in the MPC-i 
problem (jlip , are the most computationally expensive ones because they involve Minkowski sums 
and differences of polytopic sets. Next, we show how to avoid burdensome computations. 

3.1 Implicit representation of sets and Uz. 

In this section we show how to rewrite constraint (jllbp by exploiting the implicit representation 
of set Zi proposed in Section VLB of [TT]- Recalling that Z^ is the Minkowski sum of ki polytopes 
and that, for all s G : /e^ — 1, polytope Z| is described by the convex combination of points 
we have 

f G 74 if V/ G 1 : g„ 3/3f '^^ > such that /^^^^ = 1' = E /3^^^^W^''^^- 

/=i /=i 
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Algorithm 1 Design of controller C[j] for system Ejij 



Input: A^i, Bj, X^, U^, M, {Aij}j(z^/., {Xj}jgA/;, > CI{Au,B^) 
Output: controller C[,;] given by dH), and ([TTl) 

1) Compute sets Wj = 0jg_v, Aj^j and set D Wj © 5(^,(0) for a sufficiently small > 
guaranteeing Z° C X^. 

2) Solve the feasibility LP problem 9i £ 9^. If it is unfeasible stop (the controller Cj,] cannot be 
designed) . 

3) Compute as in and Uz- as in (PH)) . 

4) Compute = X,; Z,;. 

5) Compute V, = U^^ . 

6) Choose ^i(-), Vf-{-) and Xy. verifying Assumption H] 



Hence we have that X[i\{t) — X[i](0|t) G Z.; if and only if V/ G 1 : (7i,Vs G : fe; — 1 there exist 
/3f "'^^ G M such that 



/3f '^^ > (22a) 
E/?^'^=l (22b) 

XH(t) -fH(0|0 = (l-a.)-^ E E/5i''^^%l^''^^- (22c) 

In other words we add to the optimization problem pT|) the variables P^'^''^^ and replace (|llbp 
with constraints (|22ap - (|22cp . 

With similar arguments, we can also provide an implicit representation of sets Uz^. In partic- 

(s f) 

ular, we have that Uz[i] G Vz^ if and only if V/ G 1 : f/i, Vs G : fc^ — 1 there exist 0J G M such 
that 



> (23a) 

E#^) = l (23b) 
/=i 

ki-l qi 

uz^^ = (1 - a,)-' E E'^^^^^W^''^^- (23c) 
3.2 Computation of sets Xj and Vi 

In this section we show how to compute sets X^ and in (|2ip using the implicit representation 
of Zi and 15,, ■ 



9 



Using ([T^ we can rewrite = (1 — a^) ^ ©^Lo^ • Recalling that Z|, Vs 6 : fc^ — 1 are 
defined as the convex hull of points zjij'*'-^-', / g 1 : g^, we can compute the set using Algorithm 

m 

Algorithm 2 

Input: set X^ defined as in (|T^ . points Zf^]'^'-''', Vs G : fc^ — 1, V/ G 1 : and scalar a;. 
Output: set X^. 

(I) = (c^^^ , . . . , cl^ ^^ ) e M^'-x"- and A = , ■ • ■ , d^.,,^ ) G M^. 
(II) For each s e : fc^ - 1 

(i) For each / G 1 : qi 

C^ = {C^,C,) and A = (A, A - (1 -aO"'<5.^W^''^^) 

(ii) Remove redundant constraints from CiX[i^ < Di so obtaining the inequalities CiX[i] < 

(III) Set X, = : ^^[i] < Di} where C, G M^-^"' and A e K^' 



In particular, the operation in Step (|IIiip amounts to solve suitable LP problems. We can 
compute Vi using the implicit representation of U^^ in a similar way. Indeed it suffices to use 
Algorithm [3] replacing X^ with Ui defined in (fT5|) and points z^jj'^^-''' with points ujjj^^'-^^Vs G : 
- 1,V/ G 1 : qi. 

3.3 Computation of control law 

In Section [21 we introduced local controllers C[i]. Note that in ^ the control law is composed 
by the term that is computed by solving the local MPC-i problem (jlip . and the term K(z[j]) 
with Z[j] — ^[j] — . Since Ki(-) depends on , we need to solve the MPC-i problem Ijlip and then 
compute Ki(z[j]). The control law K(z[,i]) G guarantees that if a;[i] (t) — i^ij (0|t) G (i.e. MPC-z 
problem (jlip is feasible) then there is a Ai > such that X[{^ (t + 1) — (l|t) G A^Z^. To compute 
the control law Ki(z[j]) one can use the methods proposed in [TH] or in [T7]. In (TB] the authors 
propose to solve an LP problem in order to maximize the contractivity parameter Ai, i.e. for a given 
Z[i] we compute Ki(2[j]) G by minimizing the scalar A.^ such that Auz^i] + BiKi{z[i]) G AZ^ OW^. 
In |17j the authors propose an implicit representation of controller Ki{z[i]) based on the implicit 
representation ((22l) of set Z^. In our framework we want to take advantages of both approaches 
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and compute the control law Ki(-) solving the following LP problem 

P,(z[,]) : min n (24a) 



/3f'^^>0 V/ e 1 : g,,Vs G : fc, - 1 (24b) 

Qi 



and setting 



^ Pl'-^> = M Vs e : fc, - 1 (24c) 

/i > (24d) 
ZH = (l-a.)-^EE/3^'^%](^'^^ (24e) 

where P^^''^'' are the optimizers to Solving LP problem (HH), we compute a control law Ki{-) 

that tries to keep the state X[i] and the nominal state X[i] as close as possible. According to [T^ 
we can assume without loss of generality that Ki(-) is a continuous piecewise afhne map. Note 
that since C Z^, if no control action is needed in order to guarantee robust invariance. 

Indeed, in this case an optimal solution to ([M)) is /i = and '^^ = 0, V/ G 1 : gi, Vs G : fc, - 1 
and therefore Ki(z[i]) = 0. 

We are now in a position to analyze the stability properties of the closed-loop system. Defining 
the collective variables x — {x[i], . . . ,X[m]) G K", v = (wjij , . . . , ) G M"* and the function 
k{x) = (ki(x[i]), . . . , km{x[m])) ■ IR" — K™, from ^ and ^ one obtains the collective model 

x+ = Ax + Bv + Bk(x-x). (26) 

Definition 2. The feasibility region for the MPC-i problem is 

= {s[i] G Xi : (|lip is feasible for X[^{t) = S[,j]} 

and t/ie collective feasibility region is \^ = Yiis^M ■ 

Theorem 1. Let Assumptions{Jiand\^hold and assume controllers C[i^ in ^ are computed using 
Algorithm [7J Then the origin of the closed-loop system (j26p is asymptotically stable, is a 
region of attraction and x(0) G X^ guarantees constraints ([S]) are fulfilled at all time istants. 



The proof of Theorem [T] is provided in Appendix [21 

Remark 3. In Remark{ll we highlighted that the main difference with the PnP scheme proposed in 
is the computation of sets and functions Vi G Ai. We note that in the computation 

of Ki and TLi requires the solution to a nonlinear optimization problem. In this section, we have 
shown that for the PnP scheme proposed in Section\^ using results from [ITj , we can compute set 
'Li and function fii{-) solving LP problems only. 
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4 Plug-and-play operations 



In this Section wc discuss the synthesis of new controUers and the redesign of existing ones when 
subsystems are added to or removed from system ([2]). The goal will be to preserve stability 
of the origin and constraint satisfaction for the new closed-loop system. Note that plugging in 
and unplugging of subsystems are here considered as off-line operations. As a starting point, we 
consider a plant composed by subsystems i £ A4 equipped with local controllers C[i], i € A4 
produced by Algorithm [TJ 

4.1 Plugging in operation 

We start considering the plugging in of subsystem Ti^j^j^i] , characterized by parameters Am+i m+i , 
Bj^j^i, Xjv/+i, Ua/+i, Mm+i and {A^ jj-gAGiz+i ■ In particular, Nm+i identifies the subsystems that 
will be physically coupled to I][7v/+i]. For building the controller C[j\/+i] we execute Algorithm 
[T] that needs information only from systems j S Mm+i- If there is no solution to the 

feasibility LP problem in Step [2] of Algorithm [TJ we declare that cannot be plugged in. 

Let Sm+1 ~ {i '■ M + 1 ^ Afj} be the set of successors to system M + 1. Since each system 'Sy], 
j G iS^z+i has the new predecessor we have that the set already computed verifies 

C Wj and hence not all assumptions of Proposition [T] could be satisfied. Therefore, when Afj 
gets larger, for each j g Sm+i the controllers Cy] must be redesigned according to Algorithm 
[TJ Again, if Algorithm [TJ stops in Step [2J for some j £ Sm+i, we declare that cannot be 

plugged in. 

Note that redesign of controllers that are farther in the network is not needed, i.e. even without 
changing controllers C^q, i ^ {M + 1}IJiSm-i-i convergence to zero of the origin and constraint 
satisfaction are guaranteed for the new closed-loop system. 

4.2 Unplugging operation 

We consider the unplugging of system S^j.], k £ and define the set 5^ = {fc : i G A4} of 
successors to system k. Since for each i E Sk the set Mi gets smaller, we have that the set 
already computed verifies Z" D and hence assumptions of PropositionJTJare still satisfied. This 
means that for each i € Sk the LP problem in Step [U of Algorithm [TJ is still feasible and hence the 
controller C[i] does not have to be redesigned. Moreover since for each system E[j], j ^ 
the set Mj does not change, the redesign of controller Cy^ is not required. 

In conclusion, removal of system Ej^,] does not require the redesign of any controller, in order to 
guarantee convergence to zero of the origin and constraints satisfaction for the new closed-loop 
system. However, we highlight that since systems Ej^], i G Sk have one predecessor less, the 
redesign of controllers C[j] through Algorithm [TJ could improve the performance. 

5 Distributed on-line implementation of controllers Cj^j 

In Section [21 we introduced decentralized local controllers C[j] that, using the nominal model ((4j) 
and local information only, can control system i without the knowledge of the state of the prede- 
cessors. However, our framework allows one to take advantage of information from predecessors 
systems without redesigning controllers C[i]. 
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If at time t the eontroller of system Ej^j can receive the value of states X[j]{t),yj G Afi from 
predecessors, we can define the new controller C[i]''*^ as 

^W*'' • "W = ■^'H + ^t^i^li] - ^l^]AxlJ]}3£^f.)■ (27) 

In (j27p the term is the same appearing in the controller C[i] and is obtained by solving the 
MPC-i problem (|TT1) . Similarly to the control law Ki(-) in (|6]), the second term in p7|) must 
guarantee robust invariance of the set and it can be computed by solving (|24p with constraint 
(|24ep replaced by 

+ S.u.H + ^ - (1 - a.)-^ 5] £ /3^^)z[,] (28) 

where Uz[i] S M™' are additional optimization variables. The desired control term is then given by 
K^''*(a;[j] — {x[j]}j£7V'i) = Note that constraint allows us to compute sf*'*(-) taking 

into account the real state of predecessors at time t. Using Q and (P7|) . we can still guarantee 
input constraints adding the following constraints in the LP problem in ((M)) 

We highlight that the LP problem ([M)) is feasible if and only if the new LP problem is feasible. 
In fact, using the definition of robust control invariance, the LP problem is feasible if there 
exist Uz[i] £ Uz- such that z~^[i] = Auz^i^ + BiUz[i] + G Zi,Vw[i] e W^. The fact that 
5I)jeA^ ^ ^« guarantees the feasibility of both LP problems. 

We show advantages of including information from predecessors through an example. Consider 
two dynamically coupled systems equipped with controllers synthesized using Algorithm [T] and 
assume a;[i](0) = and a;[2](0) ^ ^ Z2. Without exchange of information, the solution to 
the MPC-i problem is U[i](0) = and i;[i](0) = for the first system and W[2](0) 7^ and 
2^[2](0) 7^ for the second system, hence the solution of the LP problem will be ki(z[x]) = 
and K2(z[2]) ^ 0. This means we apply a control action to system 2 only. However, a::[i](l) 7^ 
because of coupling. Differently, solving the LP problem ([M)) with constraint (j24ep replaced by 
(PS)). we obtain ki(z[i]) 7^ and «;2(2:[2]) 7^ 0. Therefore, we apply a control action on both systems 
because system 1 tries to counteract in advance coupling with system 2. 

6 Examples 

In this section, we illustrate three examples. 

1. A low-order system composed by the interconnection of two mass-spring-damper systems, 
allowing decentralized and distributed implementations of local controllers to be compared. 

2. The Power Network Systems (PNS) previously introduced in [20] and [1] where we compare 
the performance of the proposed controllers with centralized MPC and with the plug-and- 
play controllers proposed in [T]. Furthermore, we discuss plug-and-play operations corre- 
sponding to the addition and removal of power generation areas; 

3. A large-scale system composed by an array of 1024 mass-spring-damper systems. 

All examples and simulations are implemented using the PnPMPC-toolbox for Matlab [H] dedi- 
cated to the modeling of large-scale systems and the design of plug-and-play controllers. 
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6.1 Comparison of Decentralized and Distributed controllers 

In this section, we compare the performance of controllers C[.j] and Cjij'''^. We consider the example 
illustrated in Figure [TJ The system is composed by two trucks coupled by a spring and a damper. 




^[1] ^[2] 

Figure 1: Example system. 



Parameters values are: mi = 2, 7712 = 4, ki2 ~ 0.4 and hi2 = 0.3. Each truck i E A4 = {1, 2}, is a 
subsystem with state variables X[ij = {x[i^ij, a;[i.2]) and input where X[ij] is the displacement of 
truck i with respect to a given equilibrium position, ccj^ 2] is the velocity of the truck i and 100it[i] 
is a force applied to truck i. Subsystems are equipped with the state constraints < 4.5, 

2;[i.2]l < 2, i £ and with the input constraints < 1.5, i e {1,2}. We obtain models 

by discretizing the second order continuous-time system representing each truck with 0.1 sec 
sampling time, using exact discretization and treating ujj] and x^j^ , j £ Mi as exogenous signals. 
We synthesized controllers C[i], i G A4 using Algorithm[TJ At time t we compute the control action 

and apply it to the continuous-time system, keeping the value constant between time t and 
t + 1. We assume a;[i](0) ^ (0,0) and a;[2](0) = (3,0). 

In Figure [5] we show the results obtained using controllers C[i] and C[i]''*'' in the time interval 
from to 0.3 sec. We note that for the controller C[i], since X[i](0) = one has M[i](0) = 0. 
Indeed the solutions to optimization problems ([TT|) and (HH) arc f[i](0) — and ki(z[i](0)) = 0. 
For the second truck the control action is U[2](0) = —0.76 because a;[2](0) 7^ 0. However, one has 
a;[i](l) 7^ because of coupling. Using the distributed controller C[i]*'*, since a;[i](0) — and 



a;[2](0) ^ 0, one has U[i](0) = -0.012. Indeed the solution to the LP problem with ((24e| 

replaced by (pS)) . gives ki(z[i]) 7^ 0. Figure 2(a) shows the position of each truck: we note that 
using controllers C[j]'**^, the position of the first truck does not change significantly because the 
controller tries to counteract in advance coupling with system 2. This shows the benefits of a 
distributed implementation of local controllers. The state and input trajectories of the second 
truck are almost identical when using controllers C[i] and C[i]** because the state of the first truck 
is approximately zero. 



6.2 Power Network System 

In this section, we apply the proposed DeMPC scheme to a power network system composed by 
several power generation areas coupled through tie-lines. We aim at designing the AGC layer with 
the goals of 

• keeping the frequency approximately at the nominal value, at least asymptotically; 

• controlling the tie-line powers in order to reduce power exchanges between areas. In the 
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(a) Displacement of truck i controlled by Cj^j (dashed 
line) and Cjij''" (bold line). 
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and C[i]*= (bold line). 



Figure 2: Simulation in the first three time-istants with initial state x = (0,0,3,0). 



asymptotic regime each area should compensate for local load steps and produce the required 
power. 

In particular we will show advantages brought about by PnP-DeMPC when generation areas are 
connected/disconnected to/from an existing network. 

The dynamics of an area equipped with primary control and linearized around equilibrium 
value for all variables can be described by the following continuous-time LTI model [52] 

E[i]'^ : = AiiX^ii + BiU[ii + LiAPL^ + ^ A^jxij] (29) 

where X[i] ~ {A9i, Awi, AP^i, ^Pvi) is the state, U[i] = APrefi is the control input of each 
area, AP^ is the local power load and A/i is the sets of predecessor areas, i.e. areas directly 
connected to through tie-lines. The matrices of system (P^j) . the parameters values and the 

state and input constraints are provided in j20j . For each scenario, discrete-time models Sjjj with 
Ts = 1 sec sampling time are obtained from ^[i]'^ using discretization system-by-system, i.e. exact 
discretization for each area treating U[i], AP/,. and x^], j € A/i as exogenous inputs. We note that 
the proposed discretization preserves the input-decoupled structure of '^[i]'^' ■ 
In the following we first design the AGC layer for a power network composed by four areas (Scenario 
1 in |20j ) and then we show how in presence of connection/disconnection of an area (Scenario 2 
and 3 in |20j . respectively) the AGC can be redesigned via plugging in and unplugging operations. 

6.2.1 Control experiments 

Different control schemes will be compared with the centralized MFC schemes controller de- 
scribed in [20] ■ For a given Scenario, for each area, at time t control variables are obtained 
through ^ where v^i] = Ki{x[i]) and X[i] = r]i{x[i]) are computed at each time t solving the 
optimization problem and replacing (|lla[) with the following cost function depending upon 
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= (0, 0, APl„ APlJ and = AP^, 
^7Mt))= min ^ (||a;[,](fc)-XHO|lQ. + ||i'w(fc)-UHO||fl.)+I|%](t + iV,)-XHO||s. 

■U[i](t:t+JV,-l) 

(30) 

As described in |20] . this modification is necessary for acfiieving compensation of local power load. 
In the cost function (|TTal) we set Ni = 15, Qi = diag(500, 0.01, 0.01, 10) and Ri = 10. Weights Qi 
and Ri have been chosen in order to penalize the angular displacement A^^ and to penalize slow 
reactions to power load steps. Since the power transfer between areas i and j is given by 

APue^^ik) = P,j(A0,(fc) - AOjik)) (31) 

the first requirement also penalizes huge power transfers. For centralized MFC we consider the 
overall system composed by the four areas, use the cost function J^ieM^f ^^^'^ impose 

the collective constraints ([5]). In order to guarantee the stability of the closed loop system, we 
design the matrix Si and the terminal constraint set X/^i in two different ways. 

• Si is full (MPCdiag): we compute the symmetric positive-definite matrix Si and the static 
state-feedback auxiliary control law Kf'^^x\^i^, by maximizing the volume of the ellipsoid 
described by 5*^ inside the state constraints while fulfilling the matrix inequality {An + 
BiKf'"'')' S,{Au + B.Kf'''') - 5, < -Q^ - Kf'''= 'i?,;i^f"^. In order to compare centralized, 
decentralized and distributed controllers, for the centralized MFC problem we compute 
the decentralized symmetric positive-definite matrix S and the decentralized static state- 
feedback auxiliary control law K'*"''x, K"*"^ = diag(i^i, . . . , Km) by maximizing the volume 
of the ellipsoid described by S inside the state constraints while fulfilling the matrix inequality 
(A + BK'*"'')'S(A + BK"*"^) S < Q K'^"'' RK""''. 

• Zero terminal constraint (M PC zero): we set Si ^ and 'K.f. ~ x'^[i]- 

We propose the following performance criteria for evaluating different control schemes. 

• rj-index 



V = 



T 

k=a i=i 



where Tsim is the time of the simulation. From p2p . 77 is a weighted average of the er- 
ror between the real state and the equilibrium state and between the real input and the 
equilibrium input. 



• ^ -index 



$ = ^ E E E \^PueJk)\T, (33) 

fc=0 1=1 j&J^i 

where Tsim is the time of the simulation and APtie^j is the power transfer between areas 
i and j defined in pip . This index gives the average power transferred between areas. In 
particular, if the 77-index is equal for two regulators, the best controller is the one that has 
the lower value of 
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Figure 3: Power network system of Scenario 1 



6.2.2 Scenario 1 

We consider four areas interconnected as in Scenario 1 in Figure O 

For each system T,[q we synthesize the controller C^q, i G A4 using Algorithm [T] Note that in 
Step [2] of Algorithm [T] only the feasibility of LP problem is required. Therefore the synthesis of 
controllers C[i] is computationally more efficient than the nonlinear procedure proposed in [T]. 

In Figure|4]we compare the performance of the proposed DcMPC scheme with the performance 
of the centralized MPC controller described in [50]. In the control experiment, step power loads 
APl- are specified in Table 3 of [20] and they account for the step-like changes of the control 
variables in Figure|U We highlight that the performance of decentralized and centralized MPC are 
totally comparable, in terms of frequency deviation (Figure 4(a) ), control variables (Figure [4(b) | 
and power transfers APue-^ (Figure [5]). The values of performance parameter rj and $ using 
different controllers are reported in Table [T] and Table [U respectively. In terms of parameter ?/, 
plug-and-play controllers with decentralized and distributed online implementation are equivalent 
to centralized controller, however the performance of PnP-DeMPC are such that each area can 
absorb the local loads by producing more power locally (AP^e/.i) instead of receiving power from 
predecessor areas: for this reason, PnP-DiMPC has performance more similar to centralized MPC. 
Compared with plug-and-play controllers proposed in [Tj (called P&PMPC), PnP-DeMPC has 
better performances: we reduce the value of parameter 77 (PnP-DeMPC 0.0256, P&PMPC 0.0263) 
and especially the value of parameter $ (PnP-DeMPC 0.0022, P&PMPC 0.0039). This means 
that the proposed PnP-DcMPC scheme reduces tic-line powers. 



6.2.3 Scenario 2 

We consider the power network proposed in Scenario 1 and we add a fifth area connected as in 
Figure [6] Therefore, the set of successors to system 5 is 55 = {2,4}. 

Since systems Sj^j, j G 1S5 depend on a parameter related to the added system S[5], a retuning 
of their controllers is needed. Wc highlight that our framework, as also the plug-and-play method 
proposed in [T], allows for subsystems with parameters that depend upon their predecessors. In 
this case, as discussed in [1], even in the unplugging operation the successors systems have to 
retune their controllers to guarantee overall asymptotic stability and constraints satisfaction. The 
controllers Cj^j, j € {SjlJiSs are tuned using Algorithm [TJ We highlight that no retuning of 
controllers C[i] and Cpj is needed since Sjij and Epj are not predecessors of system S^sj. 
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(b) Load reference set-point in each area controlled by the proposed 
DeMPC (bold line) and centralized MFC (dashed line). 



Figure 4: Simulation Scenario 1: 4(a) Frequency deviation and |4(b)] Load reference in each area. 



In Figure [7] wc compare the performance of proposed DcMPC with the performance of cen- 
trahzed MFC. In the control experiment, step power loads AP^. specified in Table 4 of [20] have 
been used and they account for the step-like changes of the control variables in Figure [71 We 
highlight that the performance of decentralized and centralized MFC are totally comparable, in 
terms of frequency deviation (Figure 7(a)), control variables (Figure [7(b)] ) and power transfers 
APtieij (Figure [5]). The values of performance parameter 77 and $ using different controllers are 
reported in Table [T] and Table [2] respectively. In terms of parameter rj, plug-and-play controllers 
with decentralized and distributed online implementation are equivalent to centralized controller. 
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Figure 5: Simulation Scenario 1: tie- line power between each area controlled by the proposed 
DeMPC (bold line) and centralized MPC (dashed line). 



L,2 



AP, 



L,3 



AR 



re/,2- 



^[2] 



AP, 



re/, 3 ■ 



12 



APi,i 

AP^e/,1- 



APl,5 
APref,5 — 



P 



^[3] 



23 



P 



15] 



■AUJ5 



25 



11] 



45 



■AiOi 



P 



34 



14] 



■ Aua 



Figure 6: Power network system of Scenario 2 



however, as in Scenario 1, the performance of PnP-DeMPC arc such that each area can absorb the 
local loads by producing more power locally (AP^e/.i) instead of receiving power from predecessor 
areas: for this reason, PnP-DiMPC has performance more similar to centralized MPC. Compared 
with P&PMPC controllers proposed in [T], PnP-DeMPC has better performances in terms of pa- 
rameter this corresponds to a reduction of the exchanged power at the price of slightly worse 
tracking capabilities (77 increases). 



6.2.4 Scenario 3 

We consider the power network described in Scenario 2 and disconnect the area 4, hence obtaining 
the areas connected as in Figure HI The set of successors to system 4 is 1S4 = {3, 5}. 

Because of disconnection, systems ^[j], j G change their predecessors and local dynamics 
Ajj. Then, as explained in Section [B.2.31 the retuning of controllers of successor systems is needed. 
We highlight that retuning of controllers C[i] and C[2] is not needed since systems S^ij and I][2] are 
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Figure 7: Simulation Scenario 2: 7(a) Frequency deviation and |7(b)] Load reference in each area. 



not successors of system S[4]. 

In Figure [10] we compare the performance of proposed DeMPC with the performance of the 
centrahzed MPC described in [50]. In the control experiment, step power loads APi^ specified in 
Table 5 of [5D] have been used. We highlight that the performance of decentralized and centralized 



MPC are totally comparable in terms of frequency deviation (Figure 10(a) I, control variables 
(Figure [TO(b)] ) and power transfers APuei^ (Figure [TT|) . The values of performance parameter 77 
and $ using different controllers are reported in Table [1] and Table [2j respectively. In terms of 
parameter 77, plug-and-play controllers with decentralized and distributed online implementation 
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Figure 9: Power network system of Scenario 3 



are equivalent to centralized controller, however the performance of PnP-DcMPC are such that 
each area can absorb the local loads by producing more power locally (APre/,i) instead of receiving 
power from predecessor areas: for this reason, PnP-DiMPC has performance more similar to 
centralized MPC and PnP-DeMPC reduces of 40% the performance parameter $. Similarly 
to Scenario 2, compared with P&PMPC controllers proposed in [1], PnP-DeMPC has better 
performances in terms of parameter $ but worse tracking capabilities {rj increases). 



6.3 Large-scale System 

We consider a large-scale system composed by 1024 masses coupled as in Figure [13 (b) | where the 
four edges connected to a point correspond to springs and dampers arranged as in Figure [T2l Each 
mass i G M = 1 : 1024, is a subsystem with state variables xjij = (a;[i_i] , a;^, 2] 1 3^^^ 3] , X[j 4]) and 
input = (u[i,i], 2]), where x^i^^ and a;[i 3] are the displacements of mass i with respect to a 
given equilibrium position on the plane (equilibria lie on a regular grid), a;[i^2] and a;[i_4] are the 
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Figure 10: Simulation Scenario 3: 10(a) Frequency deviation and |10(b)| Load reference in each 



area. 



horizontal and vertical velocity of the mass i, respectively, and lOOw^i i] (respectively 100u\i 2]) is 
the force applied to mass i in the horizontal (respectively, vertical) direction. The values of rui have 
been extracted randomly in the interval [5, 10] while spring constants and damping coefficients are 
identical and equal to 0.5. Subsystems are equipped with the state constraints ||a;[i^j] ||oo < 1-5, 
j — 1,3, ||a;[i^;]||oo < 0.8, i G M, I ~ 2,4 and with the input constraints ||u[i]||oo < l^i, where 
/3i have been randomly chosen in the interval [1,1.5]. We obtain models S^jj by discretizing 
continuous-time models with 0.2 sec sampling time, using zero-order hold discretization for the 
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Figure 11: Simulation Scenario 3: tie- line power between each area controlled by the proposed 
DeMPC (bold line) and centralized MPC (dashed line). 





Scenario 1 


Scenario 2 


Scenario 3 




MPCdiag 


MPCzero 


MPCdiag 


MPCzero 


MPCdiag 


MPCzero 


Cen-MPC EHj 


0.0249 


0.0249 


0.0346 


0.0347 


0.0510 


0.0511 


Dc-PnPMPC 


+2.81% 


+2.81% 


+5.02% 


+4.90% 


+7.65% 


+7.65% 


Di-PnPMPC 


+3.61% 


+3.61% 


+2.31% 


+2.31% 


+2.15% 


+2.15% 


P&PMPC [J 


+5.62% 


+5.62% 


+4.62% 


+4.62% 


+5.69% 


+5.69% 



Table 1: Value of the performance parameter rj for centralized MPC (first line) and percentage 
change using decentralized and distributed MPC schemes for the AGC layer. Best values for PnP 
controllers are in bold. 





Scenario 1 


Scenario 2 


Scenario 3 




MPCdiag 


MPCzero 


MPCdiag 


MPCzero 


MPCdiag 


MPCzero 


Cen-MPC ESI 


0.0030 


0.0029 


0.0063 


0.0061 


0.0060 


0.0058 


De-PnPMPC 


26.66% 


-24.14% 


-31.25% 


-27.08% 


-42.85% 


38.09% 


Di-PnPMPC 


+0.00% 


+3.44% 


-8.62% 


-5.17% 


-7.14% 


-3.57% 


P&PMPC [J 


+16.66% 


+16.66% 


+19.05% 


+22.95% 


-11.66% 


-11.66% 



Table 2: Value of the performance parameter $ for centralized MPC (first line) and percentage 
change using decentralized and distributed MPC schemes for the AGC layer. Best values for PnP 
controllers are in bold. 



local dynamics and treating xy^, j G Afi as exogenous signals. We synthesized controllers C^q, 
i & A4 using Algorithm [T] In the worst case the time required to solve Step [5] of Algorithm [T] is 
0.2598 sec (best case 0.0140 sec). Note also that the use of a centralized MPC is prohibitive since 
for the overall system one has x G ]R^°^^, u S R^°*® and the overall state and input constraints 
are composed respectively by 8192 and 4096 affine constraints. In Figure [T5] we show a simulation 
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Figure 12: Array of masses: details of interconnections. 



where, at time t = 0, the masses are placed as in Figure 13(a) At all time steps t, the control 



action computed by the controller C;, for all i G A^, is kept constant during the sampling 

interval and applied to the continuous-time system. In the worst case, the solution of the MPC-z 
problem ^ requires 0.1047 sec on a processor Intel Core 17-2600 3.4 GHz, Ram 8GB 1.33 GHz 
running Matlab r20116. Convergence is obtained for all masses to their equilibrium position while 
fulfilling input and state constraints. State and input variables are depicted in Figure [Ml From 
Figure[T31 the settling time at 95% is 5.37 sec. For this large-scale system, we also have considered 
the use of PnP-DeMPC controllers proposed in [I], but since the design of local controllers requires 
the solution to nonlinear optimization problem and also the number of local constraints is large, 
the design procedure in [I] did not give conclusive results after several hours of computation. 




soi T irii H. 6.0 



-50 -40 -30 -20 -10 10 20 30 

(a) Position of tlic masses at initial time. 




-40 -30 -20 -10 10 20 30 40 50 

(b) Position of the masses at time 10 s (100 istant 
times). 



Figure 13: Position of the 1024 trucks on the plane. 
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(a) Displacements of the masses with respect their 
equihbrium positions. 




(b) Velocities, i.e. states a:[i_(2,4)]i * 6 





(c) Inputs i £ M- 



(d) Inputs «[i,2], * £ -M. 



Figure 14: State and input trajectories of the 1024 masses with x(0) as in Figure 13(a) 



7 Conclusions 

In this paper we proposed a decentrahzed MFC scheme based on the notion of tube-based control 
[13]. The proposed scheme guarantees asymptotic stabihty of the closed-loop system and con- 
straints satisfaction at each time instant. Our design procedures allows plug-and-play operations: 
if a new subsystem enters the network we can design a local controller using information from 
predecessor systems. Differently from [1] we can compute local controllers solving LF optimiza- 
tion problems only. Moreover, no assumption involves quantities of the overall system. Future 
research will consider generalizations of FnF-MFC design to output feedback schemes and tracking 
problems. 

A Proof of Theorem [1] 

We start introducing a definition and a few Lemmas that will be used in the proof of Theorem [TJ 



Definition 3. A convex body is a nonempty convex and compact set. 

Lemma 1. \23}j Let A and B be convex bodies. The support function of A is hA^x) ~ sup^^^ x'y 
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and it has the following properties: Ha is sublinear (i.e. hA{ax) = ahA^x), Va > and hA, 
hA{x + y) < hA{x) + hA{y)), h\A = XhA, VA > 0, /ia©s = hA + hs and A C B Ha < hs. 

Lemma 2. Let A = {x e W" : Ax < 1}, A^ [ai,.. . ,ap]^ e M^^" and assume that A Q Bp{0) 
strictly contains the origin in its interior. Then, 

a) AeBp{0) = {xeR'' -.AxK 1 - /?(||ai||, . . . , ||ap||)} 

b) p\\a,\\ <l,yiel:p 

c) defining ip ~ min.igi:^ ||ai|| one has A Q Bp{0) C (1 — l3'ijj)A 

Proof. Proceeding as is the proof of point 8 of Proposition 3.28 of |24] one gets 

A e Bp{Q) ^{xeR'^ : Ax < g} 

where g ~ (^i, . . . iji ~ 1 — /iBs(o)(^i)j /ib^(o)(-) is the support function of -B^(O). Point 
(jaj) follows from hBp{Q){x) ~ f3\\x\\ (that can be verified using the definition of support functions). 
From point (jaj) one has x € Aq Bp{Q) if and only if 

ajx < 1- /3\\a^\\, Vi G 1 :p (34) 

and in order to have that all constraints ([M]) are fulfilled for a; = and no one is active at a; = 0, 
point (jb| must be verified. 
For point (jcj), one has 

A e Bn{0) C {x eR" : Ax < {1~ /3V)1} = {x e R" : A{—^) < 1} (35) 

where the last equality holds because, from point (|b]), f3ip < 1. The rightmost set in (|35|) is 
(1 — f3ip)A and this concludes the proof. □ 

The next result shows that the control law Ri{x[.q) defined in ([25)) is homogeneous. 

Lemma 3. For G and p > one has 

i^KP^lii) = PKtiz[^), s = 0, . . . , fci - 1 

and hence Ki(pz[j]) = pKi(z[i]). 

Proof. Let / G 1 : g^, s G : fe; — 1 and p, be the optimizers to Pi(z[i]). One can 

easily verify that /Sl"'^^ = pP^^"'^^ and p = pp. fulfiU the constraints ((24b| - (pic)) for Pi(pz[i]). We 
show now that these values are also optimal for Pi(p0[j]). By contradiction, assume that 
p are the optimizers to Pi(/9Z[j]) giving the optimal cost fi < pp. One can easily verify that 
jj'f'^'' — p~^p[^'^^ and p = p'^p verify the constraints (j24b|) - (|24ep for Pi(z[j]) and yield a cost 
p^^p < p. This contradicts the optimality of /2 for Pi(z[j]). □ 

Lemma 4. Ifx[i^ G PiZ^ andw[i] G f^jZ? where pi > ?7i > 0, thenx~^[i] — AiiX[i]+BiRi{x[.i])+W[i^ G 

p,z, e {p, - ij,)zl 

Proof. Let x^i^ = ^ and = From standard arguments in |17] one can write ai^j] G Z.^ as 

ki-l 

= (1 - ai)-^ c^K^w) 

s=0 
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where (T|(.T[i]) G Z| are suitable functions. Then one has 

fei-i 

Furthermore, always from |17] one has 

= (1 - "0"^ X! (^w) 

and, from Lemma [31 



s=0 



ki-1 



s=0 



Computing one gets 

X[i\ = p.t(l - ai)^^ ^ (Aiia|(i[i]) + + 



) [rim 



> - a,)"^Z° © p,Z° © 77,Z° I e p»Z° (36d) 



s=0 
fei-1 

p,(l-aO-^0Z? 

s=l 
ki-1 

= {p,Z, ©?7,Z0}ep,Z0 
C p,Z, © (p, - ?7,)Z0 



that is the desired result. Note that 

• in (j36bp we used € Z*^^ (that holds by construction of sets Zf ); 



(36a) 

(36b) 
(36c) 



© ?7,Z^ I © p,Z° 



(36e) 

(36f) 
(36g) 



• in (j36dp we used the property that (^ © B) © B = ^, if ^ C R" and B C R" arc convex 
bodies (see Lemma 3.18 in US]), and the fact that (|18p implies Zf' C a^Z^; 

• in dSSil) wc used piU^il - ai)~'^lll © p,^ = p^{ai{l - ai)-^ + 1)2° = p,(l - ai)-^l°] 

• in we used HH); 

• in p6gP wc used the property that if p > 77 > and A and B are convex bodies, then 

{pA © rjB) QpB C pAQ{p- f])B. (37) 
The inclusion ((57|) can be shown as follows. One has, from the definition of the operator ©, 
X e ipA © i]B) Q pB -i^ X ® pB C pA ® r]B 
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and therefore, using Lemma [T] 

h{x} + ph-B < phA + Tl^B 

(38) 

h{x} + (p - 11)^3 < phA- 

Since (p — i]) > 0, one has that (p — ij)hB is the support function of (p — vi)B. Then (p8| is 
equivalent to 

x®{p- ifjB C pA 

that is X S pA Q {p — rj)B. 

□ 

Proof of Theorem [1] 

The first part of the proof uses arguments similar to the ones adopted for proving Theorem 1 both 
in [TO] and [J. 

We first show recursive feasibility, i.e. that a;[i](i) 6 Xf^, Vi G implies + 1) 6 . 
Assume that, at istant <, a;[i](<) £ X^. The optimal nominal input and state sequences obtained 
by solving each MPC-i problem Pf are W[,](0 : Ni - l\t) = {wj^j (0|i), . . . , (iV,; - l\t)] and 
X[,](0 : 7V,|i) = {xi^{Q\t),...,xi^{N,\t)}, respectively. Define W[,]'^""(7V,|t) = <"^(i[,](Ar,|t)) and 
compute i[j]''"^(A^j + according to (fTTc| from X[,](A^j|0 and V[j](A^j|i) = ?;[j]''"^(7V,|t). Note 
that, in view of constraint (|llf|) and points ([n]) and (pUj) of Assumption 01 W[i]°"^(A'i|t) G ¥i and 
i[i]'^"^(Afi + G X/; C Xi. We also define the input sequence 

: N,\t) = ■ • • , v^^{N, - z;[,]''"-(iV,|i)} (39) 

and the state sequence produced by (|llcp from the initial condition xjj] (0|i) and the input sequences 
: N,\t), 

i[,](l : TV, + l|t + 1) = {x[,](l|t), . . . ,X[,](A^,|i), (^^ + l|t)}. (40) 

In view of the constraints ((TT|) at time t and recalling that 1i is an RCI set, we have that x^i^ (t+1) — 
X[j](l|<) G "Li. Therefore, we can conclude that the state and the input sequences X[i](l : Ni + l\t) 
and W[i](l : Ni\t) are feasible at < + 1, since constraints (|llbp - (|llf|) are satisfied. This proves 
recursive feasibility. 

We now prove convergence of the optimal cost function. 

We define Pf '°(x[i] (0|t)) = min^,j.j(o:Ar,_i|t) I]flo ^ ^i(i[i] (fc), (fc)) + Vf^{x[i]{Ni)) subject to 
the constraints (|Ilcp - (jllf|) . By optimality, using the feasible control law and the corresponding 
state sequence (|40p one has 

Pf'°(5w(l|t)) <Y,t^{^,}{k\t),v^^{k\t)) + (£[/"- (AT, + l|t + 1)) (41) 

k=l 

where it has been set VYi\{Ni\t) = z;[i]'^'"(A'i|i). Therefore we have 



vf-\x^^[i\t))-vf-\x^^{m)<-m[mi)^^[^^^^^^^ 

+ y/.(i[,]— (A^, + i\t)) y/.(i[,]— (A,|t)). 

In view of Assumption HI (pv)) . from (|42p we obtain 



(42) 



f '°(xw(l|i)) -pf "(iw(i)) < -ir{x^^{t\v^^{t)) (43) 
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and therefore a;[i](0|t) — !■ and W[i](0|i) — > as t — oo. 

Next we prove stability of the origin for the closed-loop system. We highlight that this part of 
the proof differs substantially from the proof of Theorem 1 both in |^ and [T] . For the sake of 
clarity, the proof is split in three distinct steps. 

Step 1 Prove that if x(0) £ there is f > such that x{f) e Z. 

Recalling that the state x(t) evolves according to the equation (|26p . we can write 

x(t + 1) = ADx(f) + BK(x(t)) + Acx(t) + f]{t) (44) 

where 

m = B(v(t) + fi{z{t)) - S(x(i))) (45) 

and z(t) = x(<) — x(0|t). In particular, if x(0) £ X^, recursive feasibility shown above implies 
that dm) holds for alH > 0. 

Note that in view of Assumption [SJ the LP problem is feasible for all G K"'. Indeed (|24cp 
and (|24cp require that there are ^ > and £ fiZf, s G : h — 1 such that Z[i] — X]fc=o^ ^[if 
and since Z^ D Bi^.{0) (i.e. is full dimensional), these quantities always exist. This implies 
that the function R{x{t)) in is always well defined. 

We already proved the asymptotic convergence to zero of the nominal state x(0|<) and the input 
signal v(0|t) and hence we proved that 

V<5 > 0, 3Ti > : ||x(0|t)|| < S and ||v(0|t)|| < S, yt > Ti. (46) 

Moreover function k{-) is piecewise affine and continuous. In view of this, k(-) is also globally 
Lipschitz, i.e. 

3L>0 : ||k(x-x)-S(x)|| <L||x|| (47) 

for all (x, x) such that x £ X and x — x £ Z. Using (|T7)) one can show that, for all e > 0, setting 
6 — \ \B\\{i+L) following implication holds 

||x(0|i)|| < S and ||v(0|0|| <S^ \\fj{t)\\ < e, Va;(t) £ X. (48) 

Therefore, from 

Ve > 0, BTi > : ||?7(t)|| < e, Vt > Ti. (49) 
Since ||x(0|t)|| -> 0, as t -> oo, and Z contains YifLi Blo-{0), then 

y6, > 0, 3T2 > : x(0|t) £ 6,Z, Vi > Ta (50) 

and hence, from (jllbp . 

x(i) = x(0|<) + (x(t) - x(0|t)) £ (1 + 5,)Z, Vt > T2. (51) 

From we have, for alH £ A^, 

xii]{t + 1) = AuX[i](t) + BiRi{x[{i{t)) + W[{i{t). (52) 

where w^^ = X^jgA/; ^ij^lj] ^ Setting T = max{ri,r2} and using (|49l) and ([STj) . one 

has, > T 

G (1 + ^z) A.j-L, ® B,(0). (53) 
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From Assumption [3] we have 



^4j% C A,, [X, e Sp,, (0)] (54a) 

C [(A,,X,)G(Ayi3p^.,,(0))] (54b) 

C I A,,X, e I (0) I (54c) 

CW.e I A,,Sp^,,(0) (54d) 



(54e) 



Manipulations (|54b() and (|54cp are justified as follows. Let C/i, J72, Vi, V2 be convex bodies in . 
Then EH [23], 



pn X n 



• (|54b)) follows from G(C/ e V) C GC/ e GF, where G G 

• (I54cl) follows from ([/i Vi) © (t/2 V2) C (C/i e C/2) {Vi ® ^2)- 
Therefore, there is t,i G [0, 1) (that does not depend on e and (5^) such that 

A.,{Lj C e.W„ (55) 

and then, from 

G (1 + (5_,)C»W, © Be(0), Vt > r. (56) 



Note that in (|49)) the parameter e > can be chosen arbitrarily small. Assume that it verifies 
e < (1 + Ez)i^iijJi^ "ii ^ M. where uji are the radii of the balls in Assumption [5] Then, using 
Assumption [S] we get for t >T 

w[,^{t) G (1 + <5.)6(W,®B„.(0)) C {1 + S,)^,Z°. (57) 

In view of ([5T|) and (|57)) , Lemma [5] guarantees that 

G (1 + s,)iz, e (1 - 6)^°) (58) 

From Assumption [SJ one has G (1 — C G (0) and hence, since contains the 

origin in its interior, there is /i^ G [0, 1) such that Z^ G (1 — Ci)Z° C /i^Z^. From (1551) we get 

a;+[,] G (l + (5,)/^A. (59) 

If in ([50| we set Sz such that {I + Sz)^J.i < 1, we have shown that for f = T it holds 

X[,]{f+1) G Z, 

and the proof of Step 1 is concluded setting T = T + 1. 
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step 2 Prove that if x(0) £ X^, then x{t) as i ^ +00. 

Set t ^ T. Smce from Step 1 (that holds if x(0) G X^), one has X[i\ (t) S Z^, under Assumption 
m the optimizers to Ff{x[i]{t)) are U[i](0|t) = and i[i](0|t) = 0. Hence, from P5|) one has 
fj{t) = and ((5^ holds with W[i]{t) — X^jeWi Furthermore, since = Ri{x[i]) is the 

control law that makes the set RCI with respect to W[i]^ one has X[i](t + 1) £ Z^. The previous 
arguments can be applied in a recursive fashion showing that, Vt > T 

X[,]{t)eZ, (60) 

w[,]{t) = J2 ^^J=^y]it)■ (61) 

From (|60|. (|6T|) . ((55)) and Assumption [5] we also have 

'^H (^) e ^ C e,Z°. (62) 

Set i = f and Aj(t) = 1, Vi e Al. From dSHl) and dH]) it holds 

X[,](t) G A,(t)Z, (63) 
i^[,](t)eA,(t)e,Z^ (64) 

From Lemma 13] we have 

X[^{t+l) £ X,{t)Z,e{l-^^)X^{t)Z°. (65) 

From Assumption [SI it holds B^.{0) C Z°. Then 

a;[,](< + l) e A,(OZ,eB(i_^,);,,(t)^,(0). (66) 

The next goal is to compute Ai(t + 1) < Xi{t) such that 

X[,;](t + 1) e A,(t + l)Z,. (67) 

This will be achieved using Lemma [5] with A = Z.; and /? = (1 — ^i)uJi. We have to verify that 
A Q 5^(0) contains the origin in its interior and since B^.{0) G Z", it is enough to show that the 
smaller set Z^ (1 — ^i)Z^ contains the origin in its interior. 
From ([T^ one has 

z, e (1 - = ( ((1 - ^t) © (1 - c.^r'^i\ e (1 - c«)z° 



D ((1 - a.r'Z^ e (1 - © (1 - a,)-' 



=1 



where the last inclusion follows from the fact that for generic sets C, D and E in R" , it holds [25] 

(c © £>) e -B 3 (£> e £;) © c. 

Note that the origin is strictly contained in Z" (from Assumption [5]) and also in sets Zf , s G 
1 : fci — 1, (by construction). Since in ([T^l a.; G [0, 1) and we have chosen G [0, 1), one has 

(1 — ai)^^ > (1 — ^i) and therefore 

og (i-aO-^zOe(i-^^)z°. 
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Since the origin is strictly contained in all summands appearing in (j68p , it is also strictly contained 
in A e Bfs{0). Letting Z° = {z e R"' : Zfz < 1} and Z.f = [2°!, . . ■,zfgj'^, from point (|cj) of 
Lemma [5] we get 

ZO e B(i_^,)„^(0) C (1 - (1 - e.V^V'OZ^, ^^ = mm 



(69) 



From one obtains that (p7|) is fulfilled with 

r ~X,{t + I) = aM-t) 

[ Oi = 1 - (1 - 

and from point (|b]) of Lemma [5J it holds \ai\ < 1. 
From (|5T|) and (p7)) we have 

+ e0A,,A,(t + l)Z, 

and setting 

A,(t+1)= max A,(t + 1) (70) 

je^fiU{^} 

it holds 

u;[,](i + 1) e X,it + 1)( A,jZ,) C A,(t + l)e;Z° (71) 

where we used (j55[) and Assumption [5] Note that ([7T|) corresponds to (j64[) at time t + 1. Similarly, 
from dn?]) and dTD]) we have that 1^ holds at time t + Furthermore < Ai(t + 1) < 1, 
< Ai(t + 1) < 1. Therefore, the previous arguments can be applied in a recursive fashion to 
prove that §^ and ^ hold for alH > T and i £ M. 

In order to conclude the proof of Step 2, we show that Xi{t) given by (fTO)) converge to zero as 
t +00. Indeed, from (|63l) this implies that x(t) — > as t — >■ 00. Let X(t) — max^g^vi Xi(t) and 
a = maxjgTVf a,;. From (j69p and (|70p one has 

A(t + 1) = max Ai(t + 1) = max max aiXi{t) < a max max Xi(t) = dX{t) (72) 

Being a G [0, 1) and A(r) = 1, ((72|) implies that X{t) ^> as i — cxd and this concludes the proof 
of Step 2. 



Step 3 Prove stability of the origin of the closed-loop system 
Note that 

Z, C Xf (73) 

as shown at the beginning of Step 2. Moreover, from Assumption [5] and (where, from ([T5)) . 
G [0,1)) 

and then Z is a neighborhood of the origin of ffi.". For a given e > let p > be such that p < 1 
and pZ C i?e(0). As shown at the beginning of Step 2, if x G Z then problems Pf'(a;[j]), i E A4 
are feasible, the closed-loop dynamics (^5)) reduces to 

x+ = Ax + Bk(x) (74) 
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and Z is an invariant set for (j74[) . This implies that if x(0) G Z, then x(i) is well defined Vt > 0. 
In order to conclude the proof we have to show that also is invariant for ((74|) . If x 6 pZ then 
there is x G Z such that x = px. From ([7^ and Lemma [3] one has 

x^ = pAx + pBk(x) = px^ 

and since x+ G Z then x+ G pZ. 

□ 
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